Papers with psychometric framework
Defining and Evaluating Visual Language Models’ Basic Spatial Abilities: A Perspective from Psychometrics (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies assessing the spatial abilities of VLMs lack a solid theoretical foundation and lack measurable data. |
| Approach: | They propose a psychometric framework defining five basic spatial abilities in Visual Language Models. |
| Outcome: | The proposed framework defines five basic spatial abilities in Visual Language Models (VLMs) it provides a comprehensive evaluation benchmark and methodological perspective for embodied AI development . |
Quantifying and Mitigating Socially Desirable Responding in LLMs: A Desirability-Matched Graded Forced-Choice Psychometric Study (2026.acl-long)
Copied to clipboard
| Challenge: | a psychometric framework is proposed to quantify and mitigate socially desirable responding (SDR) in questionnaire-based evaluation of large language models. |
| Approach: | They propose a psychometric framework to quantify and mitigate socially desirable responding (SDR) in questionnaire-based evaluation of large language models. |
| Outcome: | The proposed framework quantifies and mitigates socially desirable responding (SDR) in questionnaire-based evaluation of large language models. |